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Abstract 




Objectives: There is a need for research which informs on 
the overall size and significance of clinical skills deficits 
among new medics, globally. There is also the need for a 
meta-review of the similarities and differences between 
countries in the clinical skills deficits of new medics. 
Design: A systematic review of published literature pro- 
duced 68 articles from Google/Google Scholar, of which 
nine met the inclusion criteria (quantitative clinical skills 
data about new medical doctors). 

Participants: One thousand three hundred twenty-nine 
new medical doctors (e.g. foundation year-1s, interns, post- 
graduate year-1 doctors). 
Setting: Ten countries/regions. 

Main outcome measures: One hundred twenty-three data 
points and representation of a broad range of clinical 
procedures. 

Results: The average rate of inexperience with a wide 
range of clinical procedures was 35.92% (lower confidence 
interval [CI] 30.84, upper CI 40.99). The preliminary meta- 
analysis showed that the overall deficit in experience is 
significantly different from 0 in all countries. Focusing on 
a smaller selection of clinical skills such as catheterisation, 
IV cannulation, nasogastric tubing and venepuncture, the 
average rate of inexperience was 26.75% (lower CI 
18.55, upper CI 35.54) and also significant. England pre- 
sented the lowest average deficit (9.15%), followed by 
New Zealand (18.33%), then South Africa (19.53%), 
Egypt, Kuwait, Gulf Cooperation Council countries and 
Ireland (21.07%), after which was Nigeria (37.99%), then 
USA (38.5%) and Iran (44.75%). 

Conclusion: A meta-analysis is needed to include data not 
yet in the public domain from more countries. These 
results provide some support for the UK General 
Medical Council's clear, detailed curriculum, which has 
been heralded by other countries as good practice. 
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Introduction 

There is some research about deficits in new medical 
doctors' experiences with different clinical tasks, 1-3 
but there is a need for research which informs on 



the overall size and significance of the deficit across 
different countries. There is also the need for 
research which compares the size of the deficit 
between countries. It is important to harmonise 
induction curricula in different countries because 
there is a high level of demand for medical profes- 
sionals, globally, 4 and good opportunities for their 
mobility between health systems. Some countries 1 
professional associations, such as the UK General 
Medical Council, have presented clear guidelines 
about educational and induction curricula, whereas 
some countries have not yet done this. 2 As a step 
towards finding out whether these country differ- 
ences matter, this article explores and presents a 
systematic review of the similarities and differences 
between countries in the clinical skills deficits of new 
medics. 

Methods 

Searching 

The search produced 68 articles. Figure 1 is a flow dia- 
gram based on Quality of Reporting of Meta-analyses 
(QUOROM), showing the process of searching, screen- 
ing and evaluating articles, and a summary of the rea- 
sons for exclusion. Appendix 1 shows the QUOROM 
checklist statements. This systematic review began with 
a search of Google Scholar for articles about new doc- 
tors' clinical skills. Search words included 'clinical 
skills', 'new medic', 'new doctor', 'newly qualified 
doctor'. This produced 42 articles, two of which were 
included. 1 ' 2 The search was repeated on Google web to 
include non-indexed journals from more countries and 
also adding regionally used labels (e.g. 'medical 
interns') and country names. This produced 26 articles, 
seven of which were included. 5-11 

Selection 

The criteria for inclusion were as follows: the data 
should be published and quantitative; the sample 
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Figure I . A flow diagram showing the process of searching, screening and evaluating articles, and a summary of the reasons for 
exclusion. 



Potentially relevant articles identified and screened 

(maximum N = 48,900 from Google Scholar; maximum N = 
12,800 from Google) 





Excluded approximate n = 61,632 




Reasons 




Non-medic sample 




Not data about clinical procedures 




Not primary data (e.g. policy or 




curricular websites) 



Retrieved for more detailed evaluation | 

Full-text retrieval of articles 



= 68) 




Excluded n = 38 



Potentially appropriate for inclusion 
(n = 30) 



Reasons 

Sample: not equivalent to new 
medics (e.g., medical students, 
mixed samples) 




Excluded (n = 21) 

Reasons: 
Qualitative data 

No data (e.g. conference abstracts) 
No data per clinical skill (e.g. 
summary across a range) 
Experience defined ambiguously 
Confidence self-ratings 
OSCE scores 

Not yet equivalent to new medics 
Survey of others' views about new 
doctors 



Included (n=9) 



Withdrawn (n = 1) 



Reason: Data from England 
collected 13 years ago and before 
GMC curriculum changes 



should be new medical doctors or at an equivalent 
level; the article should report the percentage of 
respondents with experience or inexperience in each 
clinical skill or provide scores that can be 



converted into percentages. There was no a priori 
definition of experience; articles which used compar- 
able methods of operationalising experience were 
included. 
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Validity assessment 

Nine articles met all criteria, and their extracted data 
are reported in Table 1. Details of the articles' raw 
scores and conversions to percentages are reported 
below. 

Data abstraction 

The searches, conversions of data into percentages 
and calculations were conducted by the author manu- 
ally and using SPSS. 

Study characteristics 

The first article 1 provided data from 30 postgradu- 
ate year-1 doctors (PGYls) in New Zealand, who 
were asked about their clinical skills at the start of 
their postgraduate year and again at the end. Data 
from Time-1 were used for this analysis. The PGYls 
were given a 134-item questionnaire and asked to 
rate their experience with a procedure using a 0 to 
5 scale, whereby 0 = 'never heard of the procedure 
or skill'; l='know the principle'; 2 = 'observed, or 
done on a model'; 3 = 'done with supervision or 
assistance'; 4 = 'have done independently'; 5 = 'very 
comfortable with this skill - mastered'. 1(ppl ~ 2) The 
researchers then coded responses of 3 or higher as 
experience, and the percentages reported represented 
the respondents who had performed a given skill 
under supervision, independently or mastered it. 
The second article 2 provided data from Egypt, 
Kuwait, Gulf Cooperation Council countries and 
Ireland. There were 91 medical interns who indi- 
cated the number of times they had performed 
each clinical skill, and therefore the researchers 
reported the percentage that had never performed 
each skill. The third article 5 represented data from 
100 medical clerks (equivalent to medical interns). 
The authors measured the frequency of clerks who 
have performed each task under observation <2 
times, 2-5 times, 6-9 times and >10 times. The 
fourth article 6 represented data from 91 foundation 
year-1 doctors; they were recruited from 16 NHS 
trusts in the Mersey Deanery region of England. 
The authors asked them to rate their preparedness 
for each task on a scale ranging from 1 to 5, and 
they operationalised good preparedness as a score of 
'quite well prepared' or better. The fifth article 7 rep- 
resented data from 89 newly qualified doctors in 
South Africa, who were surveyed about their intern- 
ship experiences with different tasks. They 
responded using a scale ranging from 1 to 5, 
whereby 4 represented the ability to perform the 
task independently and 5 the ability to teach it 



to someone. The sixth article represented data 
from 681 PGYls (medical interns) in USA. The 
authors also surveyed medical programme directors 
to identify the tasks that 66% of them believe are 
tasks that medical interns should be able to perform 
independently without prompting or coaching. The 
seventh article 9 represented data from 84 medical 
students in Nigeria who had just completed their 
last lecture. The authors reported the number of 
students with 0 attempts of each clinical procedure; 
an attempt was defined as the number of times the 
procedure had been successfully performed. The 
eighth article 10 represented data from 93 graduates 
in Nigeria who were about to begin their medical 
internships. The study focused on urethral catheter- 
isation, and the authors reported the percentage 
who responded that they could do this under super- 
vision or independently. The ninth article 11 repre- 
sented data from 70 medical interns in Nigeria and 
focused on episiotomies, a procedure frequently 
expected of interns in Nigeria. 

Quantitative data synthesis 

From the first article, 1 each value was subtracted 
from 100 to obtain the percentage of respondents 
who had never performed a given skill under super- 
vision, independently or mastered it (listed in 
Table 1). The data from the second article 2 were 
extracted and reported in Table 1 . The data extracted 
into Table 1 from the third article 5 represented the 
percentage with the least experience (<2 times). From 
the fourth article, 6 the frequency of the new doctors 
who rated themselves as being less than 'quite well 
prepared' was converted into a percentage and listed 
in Table 1. The scores from the fifth article 7 were 
converted into percentages; the levels of inexperience 
in Table 1 were then calculated by subtracting these 
values from 100. The percentages of interns in the 
sixth article 8 who responded that they cannot inde- 
pendently perform a task which 66% of medical pro- 
gramme directors said is expected of medical interns 
were calculated for Table 1 (excluding management 
or judgement tasks not measured in other studies and 
also including clinical procedures measured by sev- 
eral other articles in the current review). From the 
seventh article, 9 the data in Table 1 are the percentage 
of respondents who had not successfully attempted 
each procedure. The data extracted from the 
eighth article 10 represented the percentage who 
responded that they could not perform the procedure 
under supervision or independently. The data 
extracted from the ninth article 11 represented the per- 
centage of interns who had not ever performed the 
procedure. 
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Table I . Proportion of new doctors without sufficient task experience, by country. 



Proportion without 
experience 



Country 



I 



Abscess drainage 

Abscess drainage 

Abscess drainage 

Abscess examination an 
drainage 

5. Airway care 

6. Anaesthetic (local) 

7. Anaesthetic (local) 

8. Anaesthetic (local) 

9. Anorectoscopy, proctoscopy/ 
sigmoidoscopy 

10. Application of traction 

I I . Arterial blood gas 

12. Arterial blood sampling 

1 3. Arterial puncture 
4. Arterial puncture 

15. Artificial ventilation 



I 

17. 
18. 
19. 
20. 
21. 

- 



23. 

>, 

25. 
27. 



Assessment of level of 
consciousness (GCS) 

Bag/mask skills 

Bandage/strapping appli 

Bimanual palpation of adnexae 

Blood (phlebotomy) 

Blood (phlebotomy) 

Blood film - examination of 

Blood glucose (glucometer use 
Breech delivery 
Cannulation (IV) 
Cannulation (IV) 
Cannulation (IV) 




(continued) 
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Table I. Continued. 



Task 


Proportion without 
experience (%) 1 


Data 


Country 


28. Cannulation IV 


1 5.4 


2 


Egypt, Kuwait, Gulf Cooperation 
Council, Ireland 



29. Catheterisation (surgical) 



3 I . Catheterisation 

32. Catheterisation 

33. Catheterisation 

34. Catheterisation (urinary 

35. Catheterisation (urethral) 

36. Catheterisation (female) 

37. Catheterisation (Foley's) 

38. Catheterisation (male) 

39. Catheterisation (urethral) 

40. Central venous catheter 
insertion 

41. Cerumen removal 

42. Cervical collar application 

43. Cervical smear 

44. Cervical smear 

45. Cervical/vaginal speculum 
examination 

46. Chest drain insertion 

47. Chest tube insertion 

48. Closed reduction of a fracture 

49. Corneal foreign body removal 

50. CVP insertion 

5 1 . Detection of foetal heart 
sounds 

52. Dressing wound 

53. Ear canal foreign body removal 

54. ECG 



Egypt, Kuwait, Gulf Cooperation 
Council, Ireland 




Egypt, Kuwait, Gulf Cooperation 
Council, Ireland 




(continued) 
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Table I . Continued. 



55. 

, 

57. 
58. 
59. 
60. 
61. 



EKG 

Endotracheal intubatio 



Endotracheal intubation 
Endotracheal intubation 
Epistaxis (anterior) packing 
Fundoscopy 
l&D 

Injection (subcutaneous, intra- 
dermal, intramuscular, 
intravenous) 



63. Insertion of thoracic drainage 



64 

65 
66 
67 

u 
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Intercostal drain insertion 
Intramuscular injection 
Intravenous insertion 
IV administration 
IV antibiotic administration 
IV infusion 
IV infusions 
IV medication 
Joint aspiration 



73. 
75. 

77. 

79. 
80. 



Joint aspiration 

Joint aspiration 

Joint dislocation - reduction 

Laceration repair (second 
degree perineal) 



Laceration repair (simple) 
Lumbar puncture 
Lumbar puncture 
Lump excision 



Proportion without 
experience (%) f 



24 



58.2 



72 
77 
67 



Country 



USA 




Egypt, Kuwait, Gulf Cooperation 
Council, Ireland 



I 




Egypt, Kuwait, Gulf Cooperation 
Council, Ireland 





Egypt, Kuwait, Gulf Cooperation 
Council, Ireland 




(continued) 
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Table I. Continued. 



81. Microscopy - blood smear 

82. Microscopy - urine 

83. Microscopy (microbio. 
specimens) 

84. Nasal packing 

85. Nasogastric tube insertion 

86. Nasogastric tube placement 

87. Nasogastric tubing 

88. Nasogastric tubing 

89. Nasogastric tubing 

90. Operative intubation 

91. Pelvic examination 

92. Pericardiocentesis 



93. Plaster application to a fracture 



94. Pleural and peritoneal fluid 
aspiration 

95. Resuscitation (administering 
cardiopulmonary) 

96. Resuscitation (adult CPR with 
intubation) 

97. Resuscitation (cardiac 
defibrillation) 

98. Resuscitation (cardio pulmon- 
ary cerebral) 

99. Resuscitation (newborn) 

100. Resuscitation (paediatric with 
intubation) 

101. Resuscitation (paediatric) 

102. Securing airway 



103. Spirometry 

1 04. Spirometry and peak flow 

105. Splinting 



Proportion without 
experience (%) 1 



72 




47 



93 



Country 



USA 




Egypt, Kuwait, Gulf Cooperation 
Council, Ireland 






Egypt, Kuwait, Gulf Cooperation 
Council, Ireland 

Iran 

Egypt, Kuwait, Gulf Cooperation 
Council, Ireland 

New Zealand 



Iran 



Egypt, Kuwait, Gulf Cooperati 
Council, Ireland 

South Africa 



I 
I 








Egypt, Kuwait, Gulf Cooperation 
Council, Ireland 

Iran 

New Zealand 
South Africa 

South Africa 

Egypt, Kuwait, Gulf Cooperation 
Council, Ireland 

USA 

England 

Iran 




:ion 
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Table I . Continued. 



1 



106. Supra pubic aspiration 

107. Suturing 

108. Suturing 



109. Suturing (simple, wound) 

I 10. Throat culture 

III. Treatment of tension 
pneumothorax 

I 12. Urine dipstick 



I 13. Urine examination (micro 
scopic/dipstick) 

I 14. Vaginal delivery 

I 15. Vaginal delivery 

I 16. Vaginal delivery and 
episiotomy 

I 17. Vaginal delivery with 
episiotomy 



I I 8. Venepuncture 



I 

I 19. Venepuncture 
120. Venepuncture 



121. Venepuncture and IV 
cannulation 



Proportion without 
experience (%) f 



Country 





Egypt, Kuwait, Gulf Cooperation 
Council, Ireland 



USA 



Egypt, Kuwait, Gulf Cooperation 
Council, Ireland 





Egypt, Kuwait, Gulf Cooperation 
Council, Ireland 




22. Venous cut-down 



123. Wet mount and KOH study 34 

^Interpretations of the table should take into consideration how each article defined experience (see Methods). 



Results 

The significance of the rate of task inexperience 
across the 123 data points was calculated using a 
one-sample /-test with bootstrapping. This showed 
that the rate of task inexperience is significantly dif- 
ferent from 0 at p<.05, with t (df= 122) = 14.01, 
p — 0.001. The bootstrapping used a simulation of 
1000 bootstrap samples and showed a bias level of 
.01, standard error = 2.51. The mean level of task 
inexperience was 35.92% and the standard deviation 



(SD) 28.44%. The 95% lower confidence interval 
(CI) of this difference was 30.84% and the 95% 
upper CI was 40.99%. 

The average rate of inexperience was significantly 
different from 0 in all countries, with separate one- 
sample /-tests all producing p < .05. The average inex- 
perience in South Africa was 17.90% (lower CI = 
12.87, upper (3 = 23.40), t (df= 13) = 6.41, /? = .001. 
In Iran, the average inexperience was 51.33% (lower 
CI = 36.39, upper CI = 66.11), t (#=17) = 6.49, 
/?=.001. In USA, the average inexperience was 



Kamau 



9 



41.95% (lower CI = 32.10, upper CI = 52.30), 
t (df= 19) = 7.84, p=.00\. In Nigeria, the average 
inexperience was 35.34% (lower CI =15.60, upper 
CI = 55.90), t (#=9) = 3.18, /> = .011. In England, 
the average inexperience was 9.75% (lower 
CI = 5.57, upper CI =14.62), t (#=10) = 4.13, 
p — .002. In New Zealand, the average inexperience 
was 37.89% (lower CI = 26.33, upper CI = 48.89), t 
(#=27) = 6.35, /7 = .001. In Egypt, Kuwait, Gulf 
Cooperation Council countries and Ireland, the aver- 
age inexperience was 40. 1 1 % (lower CI = 3 1 .07, upper 
CI = 49.73), t (<#=21) = 8.21,/> = .001. 

A meta-analysis then calculated the combined / 
value, Winer's Z £ , using the formula 12 Z c = ^? — 
{EW/(df- 2)]}. This gave Z c = 42.61 -=- 8.74 = 
4.88. The critical t value at df= 50 for /?<.01 is 
2.68, meaning that Z c = 4.88 is significant at p< .01. 
This showed that the overall level of task inexperience 
across countries is significant. 

Analysis on a smaller set of clinical skills 

Some country datasets represented a much wider var- 
iety of clinical tasks than the datasets from other coun- 
tries. The analysis of the average level of inexperience 
in each region was therefore replicated, but this time 
restricting the analysis to clinical tasks that commonly 
occur across the different articles. This restricted list of 
tasks had 37 data points and included catheterisation, 
IV cannulation, IV administration, venepuncture and 
nasogastric tubing. The average deficit in experience 
across all countries, focusing on this smaller selection 
of clinical skills, was 26.75% (lower CI 18.55, upper CI 
35.54). The small number of data points from 
each geographic region (e.g. 3 data points) meant 
that inferential statistics were not appropriate for 
country-by-country comparisons. 

Looking at the mean deficits in five countries, the 
average level of inexperience with the smaller selection 
of clinical skills was still comparable to the average 
level of inexperience with the wider range (in 
Table 1) in five countries. These were England, Iran, 
Nigeria, USA and South Africa. In South Africa, the 
mean level of inexperience with the selected clinical 
tasks was 19.53% (SD= 15.60; lower CI = -19.23, 
upper CI = 58.29). In Iran, the mean level of inexperi- 
ence with the selected clinical tasks was 44.75% 
(SD = 37.48; lower CI = -14.89, upper CI = 104.39). 
In the USA, the mean level of inexperience with the 
selected clinical tasks was 38.5% (SD= 16.66; lower 
CI =11.98, upper CI = 65.02). In Nigeria, the mean 
level of inexperience with the selected clinical tasks 
was 37.99% (SD = 37.78; lower CI = 6.40, upper 
CI = 69.58). In England, the mean level of inexperi- 
ence with the selected clinical tasks was 9.15% 



(SD = 7.73; lower CI=1.04, upper CI= 17.26). In 
New Zealand, the mean level of inexperience with 
the selected clinical tasks was 18.83% (SD = 24.64; 
lower CI = —7.03, upper CI = 44.70) and substantially 
lower than the average level of inexperience with the 
whole range of 28 skills in Table 1 (37.89%). The same 
was true in Egypt, Kuwait, Gulf Cooperation Council 
countries and Ireland, where the mean level of inex- 
perience with the selected clinical tasks was 21.07% 
(SD = 24.85; lower CI = -5.02, upper CI = 47. 15) 
and substantially lower than the average from 
Table 1 (40.11%). 

The average skills deficits, from largest to smallest, 
were as follows: Iran, then USA, Nigeria, the com- 
bination of Egypt, Kuwait, Gulf Cooperation 
Council countries and Ireland, followed by South 
Africa, then New Zealand, then England. 

Discussion 

Statement of principal findings 

The average rate of inexperience with clinical tasks 
spanning 123 data points was 35.92% across 
England, Egypt, Gulf Cooperation Council coun- 
tries, Iran, Ireland, Kuwait, New Zealand, Nigeria, 
South Africa and USA. Calculations showed that the 
overall rate of clinical task inexperience is signifi- 
cantly different from 0 and therefore, as a global 
average, important. However, there are country dif- 
ferences. Within a selected range of procedures, the 
average skills deficits, from largest to smallest, were 
as follows: Iran, followed by USA, then Nigeria, fol- 
lowed by the combination of Egypt, Kuwait, Gulf 
Cooperation Council countries and Ireland, then 
South Africa, followed by New Zealand, then 
England. Foundation year-1 doctors in England 
therefore presented the smallest average skills deficit. 

Strengths and weaknesses of the study 

This systematic review offers a useful focus on new 
medics, presents a broad range of clinical skills and 
involves data spanning over 10 countries. This review 
is preliminary because of a lack of access to unpub- 
lished data from more countries. Second, the accept- 
able level of experience for new medics can vary from 
one clinical skill to another 8 and therefore a follow- 
up meta-analysis should take this into account. 

Strengths and weaknesses in relation to 
other studies 

There is no known systematic review of this kind but, 
compared to the methodology in non-review studies, 
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this study could have benefited from a standardised 
measure of clinical task experience. Interpretations of 
Table 1 must therefore take into account the way in 
which each article measured task experience. 

Meaning of the study: possible mechanisms and 
implications for clinicians or policymakers 

A universal approach to medical education is needed, 
given the global demand for medical professionals. 
The lower deficit rate in England provides some sup- 
port for the UK General Medical Council's clear, 
detailed induction curriculum, which has been her- 
alded by other countries as good practice. 2 This 
research shows that the UK General Medical 
Council's curriculum should be implemented in 
more countries. Clinically, the data are useful in iden- 
tifying the potential skills deficits among newly qua- 
lified recruits from other countries and the inductions 
that should be provided. 

Unanswered questions and future research 

Further research is needed to include unpublished 
data from more countries. Follow-up primary 
research should measure task inexperience in a univer- 
sal format, also clarifying the conditions under which 
the experience was gained (patients vs. simulations). 
Some studies defined 'task experience' differently than 
others, and therefore (to allow a full meta-analysis) 
future research should ensure that clinical task experi- 
ence is measured in a standard format. 
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Appendix I. QUOROM checklist. 



Heading 


Subheading/Descriptor 


Reported (Y/N) 


Page number 


Title 


Identified as a systematic review 


Y 


Title page (p. 1) 


Abstract 


Structured format 




Abstract page (p. 1 ) 




Objective 


Y 


Abstract page (p. 1 ) 




Data sources 




Abstract page (p. 1 ) 




Review methods 


Y 


Abstract page (p. 1 ) 




Results 




Abstract page (p. 1 ) 




Conclusion 




Abstract page (p. 1 ) 


Introduction 






Introduction page (p. 1) 


Methods 


Searching 




Methods page (p. 1) 




Study selection 




Methods page (pp. 1-2) 




Validity assessment 


Y 


Methods page (p.3) 




Data abstraction 




Methods page (p.3) 




Study characteristics 


Y 


Methods page (p.3) 




Quantitative data synthesis 




Methods page (p.3) 


Results 


Trial flow 




Figure 1 (p.2) 




Study characteristics 




Table 1 columns (pp.4-8) 




Quantitative data synthesis 


Y 


Table 1 columns (pp.4-8) and analysis pages (pp.8-9) 



